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Amendments to the Claims: 
This listing of claims replaces all prior versions and listings of claims in the application: 

Listing of Clain is: 

Please amend claims as follows: 

1, (Currtintly Amended) A system for multimodal infomiation services, comprising: 
a multimodal inforaiation service mechanism for providing said multimodal information 
services , said m ultimodal information services inclndins a service capable of receiving requests 
firom a user for infomiation represented in a source modality and responding to the requests by 
retrieving the infomiation in the source modality and delivering the information Hank tn the same 
user that requested the information, but in a destination modality that is different from the source 
modality : 

an information user at a user site c onnecting to a first network through at least one 
communication device, said first network connecting said user site t o said multimodal 
information service mechanism, said information user requesting and receiving said multimodal 
information services from said multimodal information service mechanism tlirough said 
communication device; 

and an ijiformation source connecting to said multimodal information service mechanism 
via a second network, said information source providing multimodal information requested by 
said information user to said multimodal information service mechanism to facilitate said 
multimodal information services , said information source being external to said user site and said 
multimodal information service mechanism. 
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2. (Original) The system according to claim 1, wherein said communication device 
includes at least one of: 

a wireless phone; a PDA; a pager; a facsimile device; or an e-mail mechanism. 

3. (Original) The system according to claim 1 , wherein said first nehvork and said 
second network include at least one of: the Internet; an intranet; a wireless network; or a public 
service telephony network. 

4. (Orioinal) The system according to claim 1, wherein said information source includes 
at least one of a 

database; a web site; and an application, 

5. (Origmal) The system according to claim 1, wherein said multimodal information 
service mechanism comprises: 

a multimodal platform; 

and at least one multimodal information service application, each of said at least one 
multimodal information service apphcation providing a service to said information user and 
being constructed based on said multimodal platform. 

6. (Currently Amended) A system for a multimodal platform, comprising: a multimodal 
connection mechanism for switching multimodal data through appropriate chaimels; and a 
multimodal interaction enabling mechanism for facilitating multimodal data rendering , whereni 
said multimodal data is requested bv a user at a user site and said multimodal interaction 
enabling mechaoism comprises: a data adapter for rendering data in a source modalitv into data 
in a destination modaUtv, said data in said source modality being obtained from an information 
source external to the user site and the multimodal platform; an adapted data storage for storing 
data in said destination modality, converted bv said data adapten and a multimodal server for 
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facilitating said data adapter to laerform said rendering said data in source modality to said data 
in destination modality . 

7. (Original) The system according to claim 6, wherein said multimodal connection 
mechanism comprises; at least one data channel for transferring data in different modalities; and 
a channel switcliing mechanism for routing multimodal data to said at least one data channel. 

8. (Cancelled). 

9. (Currtintly Amended) The system according to claim wherein said data adapter 
comprises: an aj>plication interface mechanism for performing interaction between said 
multimodal platform and a multimodal information service application; a data retrieval 
mechanism for uccessing said data in source modality from said information source; and a 
multimodal data rendering mechanism for rendering said data in source modality into said data in 
destination modality wherein said destination modality being specified by said application 
interface mechaoism based on the interaction between said multimodal platfomi and said 
multimodal information service appUcation. 

10. (Orijpnal) The system according to claim 9, wherein said multimodal data rendering 
mechanism comprises at least one of: an electronic mail renderer for rendering said data in 
source modah'ty into an electronic mail; a facsimile renderer for rendering said data in source 
modality into a facsimile; a paging renderer for rendering said data in source modality into a 
paging message; a text-to-speech renderer for rendering data in text modality into data in speech 
modality; and a speech-to-text renderer for rendering data in speech modality into data in text 
modality. 

1 1 . (On j^inal) The system according to claim 1 0, wherein said multimodal server 
comprises at least one of: a mail server for facilitating said electronic mail renderer; a facsimile 
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server for facilitating said facsimile tenderer; a short message service for facilitating said paging 
tenderer; a text-to-speech engine for facilitating text-to- speech renderer by generating audio 
speech data acct^rding to text data; an automatic speech recognizer for facilitating speech-to-text 
renderer by generating text data based on audio speech data using automated speech recognition; 
and a telephony server for facilitating said text-to-speech engine and said automatic speech 
recognizer. 

12. (Currently Amended) A system of a multimodal information service application for a 
voice-enabled Litemet access service, comprising; 

a dialog unit for performing a voice based dialog with an information user at a user site: 
a voice ('lipboard for storing tlie content of said dialog; 

a request queue for storing a service request issued by said iaforni^tion user during said 
voice based dialog, said service request requesting^ firom said voice-enabled Internet access 
service, hitemel information to be delivered to said information user in a destination modality, 
said request beijig accessed by an application interface mechanism of a multimodal platform to 
generate requesi;ed Internet information in said destination modality said requested Internet 
information being stored at a location external to said user site and said multimodal platform; 

and a result queue for storing said Internet information in said destination modatity, 
generated by said multimodal platform according to said request. 

13- (Original) The system according to claim 12, further comprising a statistics 
collection unit for gathering statistics based on said voice based dialog. 

14. (Cuixently Amended) A system ofa multimodal information service appUcation for 
multimodal e-business alert service, comprising: 

a multimodal e-business alert configuration that dictates different aspects of how said 
multimodal e-business alert service is to behave; and 

a multimodal e-business alert unit for generating a multimodal e-business alert based on a 
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multimodal e-btisiness alert specification contained in an event issued by an e-business provider 
ajid said multiinodal e-business alert configuration, said multimodal e-business alert, once 
generatedj bein^ sent to an e-business consumer according to said multimodal e-bxisiness alert 
sp ecificatj on , wherein said_multimodal e-business alert unit comprises a history database for 
storing information related to the history of sending e-business alerts to and receiving responses 
from said e-business consumer . 

15. (Original) The system according to claim 14, wherein said multimodal e-business 
alert unit comprises: at least one incoming request queue for queuing an event representing an 
alert request received from said e-business provider; an e-business alert service for constructing 
said c-business .Uert request based on said alert request and said multimodal e-business alert 
specification, for sending said e-business alert request to a multimodal platform, and for tracking 
the performanc<^ of said multimodal e-business alert service via various queues; and at least one 
outgoing request queue for queviing said e-business alert request, said at least one outgoing alert 
queue connectirig to a multimodal data rendering mechanism of a multimodal platform, each of 
said at least one' outgoing request queue corresponding to a different modality, said e-business 
alert request queued in said at least outgoing queue being accessed, by said multimodal data 
rendering mech.mism of said multimodal platform to generate an e-business alert in an 
destination modality according to said e-business alert specification and to send said e-business 
alei-t to said e-business consumer. 

16. (Original) The system according to claim 15, wherein said at least one incoming 
request queue comprises at least one of: an incoming ASAP queue for queuing an event, received 
from said e-business provider, that is to be converted into a multimodal e-business alert and that 
is specified to be sent to said e-business consumer as soon as possible; and an incoming timed 
queue for queuing an event, received from said e-business provider, that is specified to be sent as 
a multimodal e-business alert to said e-business consumer at a given time. 
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17. (Ori ginal) The system according to claim 1 5, wherein said at least one outgoing 
request queue comprises at least one of: a fecsimile queue for queuing au e-business alert request 
tliat corresponds to an e-business alert that is to be sent to said e-business consumer via 
facsimile; an electronic mail queue for queuing an e-business alert request that corresponds to an 
e-business alert that is to be sent to said e-business consumer via an electronic mail; a pager 
queue for qiieuing an e-business alert request that corresponds to an e-business alert tliat is to be 
sent to said e-business consumer via a pager; and a voice queue for queuing an e-business alert 
request that corjesponds to an e-business alert that is to be sent to said e-business consumer via a 
voice chaimeL 

IS. (Cuixently Amended) The system according to claim 15, further comprising: a 
response queue for storing an outcorne of sending an e-business alert to said e-business 
consumer; at lezist one status queue for storing information related to the performance of said e- 
business alert service; and a data recorder for recording information from said at least one status 
queue ; and a hifitory databooo for otoring information related to th e history of sending e business 
alortG to and roooiving reoponoes from said g businGgg consumor - 

1 9. (Currently Amended) A method for multimodal information services, comprising: 

receivin;*, by a multimodal information service application in a multimodal information 
service mechanism, a service request from an information user at a user site via a first network 
connecting said user site to the multimodal information service mechanism, said request being 
issued througli n communication device and requesting a service offered by said multimodal 
information sendee application; 

identifying an information source according to said request, from where the requested 
information desired by said information user can be retrieved; 

determiiung a source modality in which said requested information is represented and a 
deslinalion modality in which said requested information is to be delivered to said information 
user; 
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retrieving, by a multimodal platform in said multimodal information service mechanism, 
said requested iitformation from said infonnation source in said source modality to generate 
source infoTmatio n. said information source being located external to said user site and said 
multiTnodal information service mechanism; 

generatuig destination information from said source information by rendering said source 
information intc* said destination information, if said source information is not in said destination 
modality; 

switching said destination information into a chaimel that is appropriate for said 
destination modality; 

and sendingj by said multimodal information service application, said destination 
information to said information user from said channel to said commimication device via a 
second network 

20. (Cui-rently Amended) The method according to claim 1 9, wherein said 
communication device includes at least one of: 

a wireleHS phone; a PDA; a pager; a facsimile device; or an electronic mailing 
mechanism. 

21. (Original) The method according to claim 19, wherein said first network and said 
second network include at least one of: 

the Internet; a wireless network; or a public service telephony network. 

22. (Original) The method according to claim 19, wherein said information source 
includes at leasi one of: 

a database; a web site; and an application. 

23- (Original) The method according to claim 19, further comprising storuig said 
destination information, rendered by said rendering, in an adapted data storage. 
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24. (Ciirrently Amended) A multimodal infonnation service application method for 
voice-enabled Litemet access service, compiisiBg: 

conducting, by a dialog unit in said multimodal information service application:, a 
conversation with an information user at a user site via a coimnunication device; updating a 
clipboard acconling to said conversation; 

processing said conversation to extract a request for information, specified by said 
information user, and a destination modality in which said information is to be sent to said 
infonnation user, 

sending said request for information and said destination modality to a multimodal 
platform tliat fai:j]itates data rendering among different modalities , said requested information 
being located external to the user site and to the multimodal platform: 

generatuig, by said multimodal platform, destination information by rendering said 
informatioD into said destination modality according to said request; 

receivin:>, by said multimodal information service application from said multimodal 
platform, said destination information; 

and sending said destination information to said information user, 

25. (Original) The method according to claim 24, wherein said conversation comprises 
at least one dialog, each of said at least one dialog including a prompt and a response. 

26. (Original) The method according to claim 25, wherein said clipboard stores the 
content of said iit least one dialog according to a schema defined in a standard language. 

27. (Original) Tlae method according to claim 26, wherein said standard language 
includes Voice Extensible Markup Language. 
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28. (Original) A method of multimodal infoimation scTvice application for multimodal 
e-business alert service, comprising: constructing a multiniodal e-business alert configuration 
that dictates how said multimodal e-business alert service is to behave; issuing an event, by an e- 
business provider, to said multimodal e-business alert service, said event requesting said 
multimodal e-business alert service to send an e-business alert to an e-business consumer, said 
event including a multimodal e-business alert specification that instructs said multimodal e- 
business alert service how said e-business alert is to be sent to said e-business consuxaer; 
sending, by said multimodal information service application, a multimodal e-business alert to 
said e-business ijonsiuner based on said multimodal e-business alert configuration and said 
multimodal e-business alert specification contained in said event, said multimodal e-business 
alert being rend^sred by a multimodal platform in a multimodal information service mechanism. 

29. (Original) Tbe method according to claim 15 and claim 28, wherein said 
multimodal e-business alert specification comprises: an e-business history; and a push, 

30. (Original) The method according to claim 29, wherein said push comprises at least 
one of: at least one criterion under which a multimodal e-business alert is to be sent to said e- 
business consumer; a default means by which said multimodal e-business alert is to be sent to 
said e-business ';onsunier3 or zero or more altemative means to send said multimodal e-business 
alert when an attempt to send said e-business alert using said default means fails, said zero or 
more alternative; means being applied when a condition is satisfied. 

3 1 . (Ori ginal) The method according to claim 30, wherein said default means and said 
zero or more altemative means include at least one of: electronic mail; facsimile; pager; wired 
phone; or wireltjss phone. 

32. (Original) The method according to claim 30, wherein said condition includes a 
situation in which a phone, to where an e-business alert is sent using said default means, is busy. 
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33. (Ori ginal) The method according to claim 30, wherein said condition includes the 
situation in which a phone, to where an e-business alert is sent via one of said zero or more 
alternative meaiis, is not answered. 

34. (Original) The method according to claim 30, wherein said sending a multimodal e- 
business alert comprises: receiving, by said multimodal information service application, said 
event from said e-business provider; retrieving said e-business alert configuration associated 
with said e-business consumer; processing said multimodal e-business alert specification to 
generate said e-business alert request; pushing said e-business alert request into one of a plurality 
of outgoing request queues; generating, by said multimodal platfoim, said e-business alert based 
on said e-businc ss alert request; and sending said e-business alert to said e-biisiness consumer 
using said default means through a multimodal coimection mechanism in said multimodal 
platform. 

35 . (Qri ginal) The method according to claim 34, further comprising: exaxnining an 
i-esponse yieldecl from said sending to see whether said sending is successful, said examining 
generating an outcome of either negative or positive; updating an e-business history, if said 
outcome is positive; repeating the acts starting from said procrasing, if said alternative means is 
defined in said multimodal e-business alert specification. 

36. (Currently Amended) A computer-readable medium encoded with a program for 
multimodal information services, said program comprising: 

receivin;>, by a multimodal information service apphcation in a multimodal information 
service mechanism, a service request from an information user at a user site via a first network 
connecting said user site to the multimodal infomiation service mechanism, said request being 
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issued through a communication device and requesting a service offered by said multimodal 
information sendee application; 

identifying an information source according to said request, from where the requested 
infoxmation des ired by said information user can be retrieved; 

determining a source modality in which said requested information is represented and a 
destination modality in which said requested information is to be delivered to said infonnation 
user; 

retrieving, by a multimodal platform in said multimodal information service mechanism, 
said requested information from said information source in said source modality to generate 
source informatio n, said information source being located external to said user site and said 
multimodal infcmaation service mechanism: 

generating destination information from said source infonnation by rendering said source 
infonnation intc> said destination information, if said source infonnation is not in said destination 
modality, 

switching said destination infonnation into a channel that is appropriate for said 
destination modality; 

and sending, by said multimodal information service application, said destination 
infonnation to said information user Ecom said channel to said commimication device via a 
second network. 

37. (Original) The medium according to claim 36, said program further comprising 
storing said destination information, rendered by said rendering, in an adapted data storage, 

38, (Original) A computer-readable medium encoded with a program for voice-enabled 
Internet access service, application, a conversation with an infonnation user via a commimication 
device, updating a clipboard according to said conversation; processing said conversation to 
extract a request for information, specified by said information user, and a destination modality 
in which said infonnation is to be sent to said information user; sending said request and said 
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destination modality to a multimodal platfomi that facilitates data rendering among different 
modalities; 

generating, by said multimodal platform, destination information by rendering said 
information intc* said destination modality according to said request; 

receivin;^, by said multimodal information service application from said multimodal 
platform, said destination information; and 

sending said destination information to said information user. 

39. (CuiTiently Amended) A computer-readable medium encoded with a program for 
multimodal e-business alert service, said program comprising: 

constructing a multimodal e-business alert configuration that dictates how said 
multimodal e-business alert service is to behave; 

issuing ^^n event, by an e-business provider, to said multimodal e-business alert service, 
said event requesting said multimodal e-business alert service to send an e-business alert to an e- 
business consumer, said event including a multimodal e-business alert specification that instmcts 
said multimodal e-business alert service how said e-business alert is to be sent to said e-business 
consiuner; 

sending, by said multimodal infoimation sor v ico anplicatio nc -business alert service, a 
multimodal e-business alert to said e-business consumer based on said multimodal e-business 
alert configuration and said multiroodal e-business alert specification contained in said event, 
said multimodal e-business alert being rendered by a multimodal platform in a multunodal 
information service mechanis m: and 

storing a history of the e-business alert sent by the multimodal e-busincss alert service 

and responses n reived fix)m said e-business consumer . 

40, (Original) The medium according to claim 39, wherein said sending a multimodal e- 
business alert comprises: receiving, by said multimodal information service application, said 
event firom said e-business provider? retrieving said e-business alert configuration associated 
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with said e-busiaess cQTisumer; processing said multiinodal e-business alert specification to 
generate said e-business alert request; pushing said e-business alert request into one of a plurality 
of outgoing request queues; generating, by said multimodal platfonn, said e-business aleit based 
on said e-busincss alert request; and sending said e-business alert to said e-business consumer 
using said default means through a multimodal connection Tueschanisni in said midtimodal 
pJatfomi. 

41. (Cuirently Amended) The medium according to claim 40, said program further 
comprising: examining an response yielded from said sending to see whether said sending is 
successful, said examining generating an outcome of eithernegative or positive; updating thea» 
e busin e ss history, if said outcome is positive; repeating the acts starting from said processing, if 
said alternative means is defined in said multimodal e-business alert specification. 

42. (N^^) Tlie method of claim 19, further comprising: 

storing tbe generated destination information at said multimodal platform for future use, 
said multimodal platfonm being external to the user site. 

43. (New) The metliod of claim 42, wherein generating destination information from 
said source information comprises: 

determining whether said source information in said destination modality already exists 
in said multimodal platform; and 

if said source infonnation already exists^ then using the existing information as the 
destination infoimation instead of generating the destination information; otherwise, generating 
the destination information. 

44. (New) The system of claim 1, wherein the multimodal information service ' 
mechanism is operable to perform operations comprising: 
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converting said requested multimodal infoTroation from a source modality in from the 
source modality; and 

storing said converted information at the multimodal information service mechanism for 
fliture use, the nmltimodal information service mechanism being external to the user site. 

45. (New) The system of claim 44, wherein converting said requested multimodal 
inforaiatioii comprises: 

detenniriing whether said converted information already exists in the multimodal 
information sendee mechanism; and 

if said c< inverted information already exists, then using the existing information; 
otherwise, converting said requested multimodal information. 



PAGE 1 7122 ' RCVD AT 2/24/2005 8:33:25 PM [Eastern Standard Time] * SVR:USPT0-EFXRF-1/1 ' DNIS:8729306 ' CSID:6508395071 * DUfWTION (fnfn-ss):06-22 



